Skip to content

Add rotating kvcache to save space#1

Merged
Blaizzy merged 1 commit intoBlaizzy:pc/add-cohere2-archfrom
N8python:add-cohere2-arch-rotating-kv-cache
Dec 14, 2024
Merged

Add rotating kvcache to save space#1
Blaizzy merged 1 commit intoBlaizzy:pc/add-cohere2-archfrom
N8python:add-cohere2-arch-rotating-kv-cache

Conversation

@N8python
Copy link

No description provided.

@Blaizzy Blaizzy merged commit 20d7925 into Blaizzy:pc/add-cohere2-arch Dec 14, 2024
@Blaizzy
Copy link
Owner

Blaizzy commented Dec 14, 2024

Merged!

Pushing changes now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants